Package-level declarations
Types
Link copied to clipboard
Reports a runner's discovery failures once per change, not once per attempt.
Link copied to clipboard
interface LateArrivingModels
Declares that a named provider's models may appear AFTER startup.
Link copied to clipboard
A model a local runner is serving right now.
Link copied to clipboard
class LocalModelBeans(source: LocalModelSource, properties: ConfigurableModelProviderProperties, discovery: LocalModelDiscoveryProperties)
The three objects a local runner's autoconfiguration publishes, built over ONE catalog.
Link copied to clipboard
class LocalModelCatalog(source: LocalModelSource, discovery: LocalModelDiscoveryProperties, ticker: () -> Long = System::nanoTime) : LateArrivingModels
What a LocalModelSource is serving, cached for long enough that asking is not an HTTP round trip per embedding.
Link copied to clipboard
data class LocalModelDiscoveryProperties(var enabled: Boolean = true, var refreshInterval: Duration = Duration.ofSeconds(10), var missRefreshInterval: Duration = Duration.ofSeconds(1))
How often a local runner is re-asked what it serves.
Link copied to clipboard
class LocalModelEmbeddingRoleResolver(catalog: LocalModelCatalog, properties: ConfigurableModelProviderProperties) : EmbeddingRoleResolver
Satisfies an embedding role with a model a local runner is serving RIGHT NOW.
Link copied to clipboard
What a model a local runner is serving is FOR.
Link copied to clipboard
class LocalModelRoleResolver(catalog: LocalModelCatalog, properties: ConfigurableModelProviderProperties) : RoleResolver
Satisfies a chat role with a model a local runner is serving RIGHT NOW.
Link copied to clipboard
interface LocalModelSource
A local model runner - Docker Model Runner, LM Studio, Ollama - asked what it is serving NOW.